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Introduction 


Loss  of  situation  awareness  (LSA)  is  an  important  contributor  to  human-error  mishaps  in 
aviation  and  other  domains.  Loss  of  situation  awareness  occurs  when  one’s  perception  or 
comprehension  of  the  environment  or  significant  events  is  inaccurate.  The  most  common  type  of 
LSA  is  Level  I  LSA,  i.e.,  the  failure  to  perceive  the  information  needed  to  maintain  accurate 
situation  awareness  (Endsley,  1995).  For  example,  when  a  pilot  is  in  a  banking  turn,  the  resultant 
forces  on  the  aircraft  are  roughly  aligned  with  the  pilot’s  torso,  causing  an  illusion  of  straight- 
and-level  flight,  especially  during  distraction  from  the  attitude  indicator. 

Aviation  spatial  disorientation  (SD)  can  be  described  as  a  pilot’s  inaccurate  perception  of 
the  altitude,  position,  or  motion  of  his/her  aircraft  relative  to  the  Earth’s  surface  or  other  points  of 
reference  (Benson,  1989).  Spatial  disorientation  typically  (but  not  always)  occurs  within  some 
form  of  degraded  visual  environment  (DVE)  such  as  flight  under  instrument  conditions  or  at 
night  (Gibb,  Gray,  &  Scharff,  2010).  If  not  recognized  and  resolved  quickly,  this  misperception 
can  cause  controlled  flight  into  the  ground,  midair  collision,  or  inappropriate  control  inputs.  The 
prevalence  of  this  problem  has  been  documented  by  mishap  reports  and  surveys  indicating  that 
nearly  all  pilots  experience  some  form  of  SD  during  their  careers  (Braithwaite,  Dumford, 
Crowley,  Rosado,  &  Albano,  1998;  Singh  &  Navathe,  1994;  Tormes  &  Guedry,  1975).  Accident 
statistics  help  quantify  the  size  and  severity  of  this  deadly  threat  to  aviation  safety.  Poisson  and 
Miller  (2014)  reviewed  mishap  data  from  the  United  States  Air  Force  (USAF)  Safety  Center’s 
Air  Force  Safety  Automated  System  (AFSAS).  This  review  evaluated  the  21  year  period  from 
Fiscal  Years  1993  through  2013,  and  it  focused  upon  Class  A  mishaps,  which  resulted  in  a  loss 
of  life  and/or  more  than  $2  million  in  property  damage.  The  authors  found  a  total  of  601  Class  A 
mishaps,  and  72  (12%)  of  these  included  SD  as  a  causal  factor.  Tragically,  there  were  101  lives 
lost  in  those  72  mishaps.  When  fatality  rates  of  non-SD  and  SD-related  Class  A’s  were 
compared,  it  was  found  that  16.1%  of  non-SD  mishaps  involved  a  fatality,  but  61.1%  of  the  SD- 
related  mishaps  were  fatal. 

Spatial  disorientation  is  a  problem  for  the  Army  and  Navy  as  well.  In  a  study  of  the  U.S. 
Army,  Braithwaite,  DeRoche,  Avarez,  and  Reese  (1997)  reported  that  between  1987  and  1995, 
there  were  970  Class  A  through  C  mishaps.  Of  these,  291  (30%)  involved  SD  and  claimed  1 10 
lives.  A  more  recent  U.S.  Army  Combat  Readiness  Center  review  of  fiscal  2002  through  fiscal 
2013  data  showed  that  DVE  was  a  key  factor  in  25%  of  Class  A/B  mishaps,  with  DVE  mishaps 
accounting  for  46%  of  total  fatalities  (Edens  &  Higginbotham,  2014).  Flying  in  a  DVE  with  a 
correct  mental  model  of  one’s  orientation  and  motion  would  not  be  hazardous,  but  it  becomes 
hazardous  when  improper  control  inputs  are  made  because  an  accurate  mental  model  of  what  is 
happening  in  time  and  space  is  lost,  for  example,  due  to  SD.  The  U.S.  Naval  Safety  Center 
indicates  that  SD  was  designated  the  top  aeromedical  causal  factor  of  Class  A  mishaps  occurring 
from  1990  -  2008  (Gibb,  Ercoline,  &  Scharff,  2011). 

In  the  huge  general  aviation  (GA)  community,  SD  has  been  cited  as  a  causal  factor  in 
11%  to  16%  of  all  fatal  accidents  (Collins  &  Dollar,  1996;  Kirknum,  Collins,  Grape,  Simpson,  & 
Wallace,  1978).  In  GA  accidents  that  were  attributed  to  SD,  the  chances  of  survival  were 
alarmingly  low,  with  90%  of  the  studied  cases  involving  fatality.  Similarly,  Mortimer  (1995) 
found  92%  of  GA  SD  accidents  to  be  fatal. 


1 


Loss  of  control  inflight  (LOC-I)  and  controlled  flight  into  terrain  (CLIT)  are  frequently 
mentioned  commercial  aviation  problems  that  are  strongly  associated  with  SD  (Veronneau  & 
Evans,  2004;  Lawson,  Smith,  Kass,  Kennedy,  &  Muth,  2003).  A  report  from  Boeing  (2014) 
listed  LOC-I  and  CLIT  as  the  top  two  causes  of  fatalities  in  the  worldwide  commercial  jet  fleet 
(of  any  manufacturer)  in  the  period  covered  from  2004  through  2013.  The  total  number  of  lives 
lost  in  the  16  LOC-I  and  16  CLIT  accidents  was  a  staggering  2,380. 

Clearly,  SD  is  a  threat  to  safety  in  the  military,  general,  and  commercial  aviation 
communities.  Traditional  approaches  to  combatting  SD  have  focused  on  training,  ranging  from 
simple  demonstrations  in  a  Barany  chair  to  sophisticated  motion-based  flight  simulators,  to 
training  in  actual  aircraft  in  simulated  instrument  flight  conditions.  Other  methods  of  reducing 
SD  incidence  have  concentrated  on  novel  visual  instrument  design.  While  these  approaches 
certainly  have  merit,  the  fact  that  the  SD  mishap  rate  is  not  decreasing  (Gibb,  Ercoline,  & 

Scharff,  2011)  any  further  suggests  that  other  strategies  should  be  considered.  Our  approach  is 
to  gain  a  better  understanding  of  the  root  causes  of  SD  and  to  foster  the  development  and 
validation  of  models  that  can  simulate  and  predict  SD  during  a  wide  variety  of  relevant  stimulus 
situations  known  to  occur  in  flight.  This  can  aid  greatly  with  mishap  analysis  and  mishap- 
prevention  training. 

We  have  recommended  that  mishap  evaluations  should  not  simply  link  a  mishap  to  a 
possible  SD  illusion  logically  and  qualitatively,  but  instead  should  be  more  quantitative, 
comprehensive,  and  evidence-based  (Newman,  Lawson,  Rupert,  &  McGrath,  2012).  A  better 
approach  to  inferring  SD  as  a  mishap  contributor  entails  matching  data  streams  from  the  on¬ 
board  recorders  (e.g.,  acceleration,  pilot  control  inputs)  against  scientific,  quantitative  models  of 
SD  to  determine  if  SD  would  occur.  The  flight  parameter  data  provide  the  force  vectors 
experienced  by  the  aircrew  prior  to  the  mishap.  The  existing  SD  models  use  vector  analysis  to 
exploit  this  information  and  knowledge  of  perceptual  functioning  from  basic  science  (e.g., 
dynamics  of  vestibular  and  somatosensory  responses)  to  model  what  the  pilot  would  have 
perceived  if  he/she  was  not  adequately  attending  to  veridical  orientation  cues  from  the  aircraft 
attitude  instruments  or  outside  visual  cues. 

We  developed  a  mathematical  model  of  orientation  to  aid  in  the  processing,  simulation, 
and  visualization  of  human  perception  in  response  to  three-dimensional,  complex,  multisensory 
motion  stimuli  (Newman  et  al.,  2012;  Newman,  Lawson,  McGrath  &  Rupert,  2014;  Newman  et 
al.,  2016).  The  model  has  already  been  used  successfully  to  reproduce  human  perceptual 
responses  to  more  than  a  dozen  laboratory  motion  perceptions  and  spatial  disorientation 
illusions,  including  an  L/A-18  mishap  and  the  disorienting  and  disturbing  Coriolis  cross-coupling 
sensations  associated  with  certain  motion  profiles  aboard  advanced  centrifuge-like  devices  such 
as  the  new  Disorientation  Research  Device  (Newman  et  al.,  2012).  Moreover,  our  model  (and  six 
other  perception  models)  were  programmed  into  a  prototype  software  algorithm  to  facilitate 
comparison  with  previous  research  and  modeling  results  as  well  as  our  predictions. 

In  our  model,  three-dimensional  vectors  of  linear  acceleration  and  angular  velocity  are 
provided  to  the  vestibular  system  model  in  a  head-fixed  coordinate  frame  (Newman  et  al.,  2016). 
Angular  velocity  is  integrated  using  a  quaternion  integrator  to  keep  track  of  the  orientation  of 
gravity  with  respect  to  the  head.  The  otolith  transfer  functions  are  modeled  as  unity  and  respond 
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to  the  gravitoinertial  force.  The  semicircular  canals  (SCC)  are  modeled  as  second-order  high- 
pass  filters  with  a  cupula-endolymph  long  time  constant  of  5.7  seconds  (s)  and  a  neural 
adaptation  time  constant  of  80  s.  Vestibular  information  is  combined  with  visual  input  from  up  to 
four  visual  cues;  these  include:  visual  position,  visual  velocity,  visual  angular  velocity,  and 
visual  gravity /orientation.  The  above  inputs  must  then  be  integrated.  Afferent  signals  from  the 
semicircular  canals,  otoliths,  and  visual  sensors  are  compared  in  the  central  nervous  system 
“Observer”  portion  of  the  model  against  expected  values  from  a  similar  set  of  internal  sensory 
dynamics  based  on  the  literature.  The  resultant  error  signals  are  weighted  with  nine  free 
parameters  weighing  various  aspects  of  vestibular  angular  velocity  and  linear  acceleration,  visual 
position,  orientation,  linear  velocity,  and  angular  velocity,  the  gravitoinertial  force  and  its 
influence  on  the  angular  velocity  estimate,  and  the  total  estimate  of  angular  velocity.  The  model 
outputs  are  central  estimates  of  perceived  linear  acceleration,  gravity,  angular  velocity,  linear 
velocity,  and  position. 


Approach 

•  As  part  of  a  Small  Business  Innovative  Research  effort  and  a  Defense  Health  Program  Joint 
Program  Committee  project,  a  group  of  orientation  experts  were  consulted  to  determine  how 
best  to  improve  the  existing  orientation  model.  Three  rounds  of  meetings  were  held: 

o  The  first  was  a  small  two-day  in-person  meeting  at  Fort  Rucker,  AL,  in  January  of 
2015  (Appendix  A).  It  was  attended  by  small  team  of  spatial  orientation  mathematical 
modeling  specialists  and  orientation  experts  who  had  participated  in  projects  on 
quantitative  orientation  modeling. 

o  The  second  meeting  was  a  teleconference  in  March  of  2015,  which  included  some 
additional  spatial  disorientation  experts  from  the  aeromedical  domain.  This  meeting 
was  held  to  ensure  operational  relevancy  and  add  any  missing  elements  from  the  first 
meeting. 

o  The  third  meeting  was  staged  as  a  larger  in-person  two-day  workshop  at  the  Institute 
of  Human  and  Machine  Cognition  in  Pensacola,  FL,  in  January  of  2017. 

•  This  report  describes  the  committee  recommendations  from  the  first  two  meetings  (Table  1). 

o  The  third  meeting  of  a  larger  group  of  experts  included  many  formal  presentations 
and  a  raw  proceedings  transcript  of  more  than  700  pages.  This  third  meeting  will  be 
discussed  separately  in  an  upcoming  publication. 

•  In  the  first  two  meetings,  the  orientation  experts  were  tasked  with  defining  a  research  and 
development  agenda  for  refinement  of  the  existing  explanatory  mathematical  model  of 
human  spatial  orientation  perception.  Therefore,  discussion  topics  at  the  first  two  meetings 
included: 

o  Identifying  gaps  in  current  orientation  model  data  or  accuracy  of  the  model. 

o  Agreeing  on  the  key  literature  on  orientation  perception  containing  methods  or 
constraints  relevant  to  the  model  and  data  for  which  the  model  must  account. 

o  Considering  the  options  for  psychophysical  measures  needed  to  inform  and  validate 
the  model. 
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•  The  group  findings  concerning  these  various  topics  are  described  in  the  next  section  of  this 
report. 


Table  1.  Spatial  orientation  and  orientation  modeling  experts  providing  feedback.1 


Name 

Title 

Affiliation 

Angus  Rupert,  M.D.,  Ph.D. 

Medical  Research  Scientist 

USAARL 

Ben  Lawson,  Ph.D. 

Research  Psychologist 

USAARL1 2 3 

William  Ercoline,  Ph.D. 

Senior  Manager/Scientist 

Wyle  Science  Technology  & 
Engineering 

Braden  McGrath,  Ph.D. 

Vice  President  of  Strategy 
&  Development 

Engineering  Acoustics,  Inc. 

Henry  Williams,  Ph.D. 

Research  Psychologist 

Naval  Medical  Research  Unit 
Dayton 

Kara  Beaton,  Ph.D. 

Research  Engineer 

NASA  Johnson  Space  Center4 

Mike  Newman,  M.S. 

Research  Scientist 

National  AeroSpace  Training 
&  Research  Center 

Torin  Clark,  PhD. 

Assistant  Professor 

University  of  Colorado, 
Boulder 

Findings 

The  orientation  experts  discussed  the  most  important  ways  to  improve  the  orientation 
model.  They  identified  the  perceptual  phenomena  accounted  for  by  the  model,  the  relevant 
phenomena  yet  to  be  accounted  for,  and  the  top-five  knowledge  gaps  that  need  to  be  filled  by 
further  research  to  mature  the  orientation  model  for  its  intended  uses.  They  also  discussed 
optimal  approaches  to  the  measurement  of  orientation  perception  in  future  studies  seeking  to 
gather  data  in  a  form  the  model  can  readily  digest  and  incorporate  in  order  to  render  improved 
simulations.  Finally,  the  experts  identified  the  key  literature  on  human  spatial  orientation 
perception  for  which  a  fully  mature  model  should  eventually  be  able  to  account  for.  These 
committee  findings  are  elucidated  in  this  report.  Many  of  the  findings  and  recommendations  are 
summarized  immediately  below,  but  a  few  require  lengthy  tabular  information  that  is  more 
appropriate  for  the  appendices  at  the  end  of  this  report. 

Perceptual  Phenomena  for  which  the  Model  should  account 

Nearly  30  orientation  perception  phenomena  were  discussed  by  the  experts  during  their 
efforts  to  summarize  the  perceptions  already  accounted  for  by  the  mathematical  model  of 


1  Also  providing  support  and  feedback  were  two  non-SD  specialists  with  extensive  experience  in  military  aviator 
research,  physiology,  and/or  performance:  Dr.  Bruce  Wright  of  the  Civil  Aeromedicine  Medical  Institute,  and  Dr. 
Gary  Zets  of  Engineering  Acoustics  Inc. 

2  Currently  affiliated  with  the  Naval  Submarine  Medical  Research  Laboratory,  Groton,  CT. 

3  Currently  affiliated  with  nuCoria  (Canberra,  Australia)  and  with  Embry-Riddle  Aeronautical  University  (Daytona 
Beach,  FL). 

4  Currently  affiliated  with  Wyle  Science,  Technology,  and  Engineering,  Houston,  TX. 
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orientation,  the  phenomena  yet  to  be  incorporated,  and  whether  the  solution  to  filling  model  gaps 
requires  more  empirical  data,  more  refinement  of  the  model,  or  both.  These  detailed  discussions 
are  briefly  summarized  in  table  form  (Appendix  2).  The  consensus  was  that  the  model  explains 
many  important  perceptual  phenomena  (Newman  et  al.,  2012),  but  that  more  empirical 
laboratory  data  are  needed  from  perception  experiments  to  refine  model  predictions. 

Key  Research  Gaps 

Table  2  shows  the  type  of  research  that  is  needed  to  improve  the  mathematical  model  of 
orientation  perception.  Key  study  topics  are  listed  and  prioritized  in  terms  of  their  overall 
importance  (Col  A),  as  well  as  their  specific  importance  to  developing  the  model  to  maturity  to 
allow  for  wider  dissemination  (Col  B)  versus  extending  the  model  to  new  applications  not 
strictly  essential  for  initial  widespread  dissemination  (Col  C). 


Table  2.  Key  research  questions. 


A.  Top  10  Model-Relevant  Questions  Needing 
Further  Research 

B.  Top  5  Questions 
to  Answer  in 
Order  to 

Develop  and 
Mature  the 
Model 

C.  Top  5  Questions 
to  Answer  in 
Order  to  Extend 
the  Model  to 

New 

Applications 

1.  How  should  the  input  from  different  sensory 
modalities  be  weighted  to  achieve  an  optimal 
estimate  of  the  central  perception  of 
orientation  and  self-motion? 

a.  Accurately  predicting  reliance  upon 
visual,  auditory,  or  tactile  input 
during  various  multisensory 
scenarios.  (Relevant  to  vection,  3D 
audio,  tactile  displays) 

1st  ranked 

2.  What  are  the  orientation/  motion  perceptions 
and  motion  sickness  responses  to  be  expected 
during  very  low-frequency  linear 
acceleration? 

a.  Model  awaits  sufficient  empirical 
data  at  very  low  frequencies,  which 
are  relevant  to  military  vehicle  effects 

2nd 

3.  How  will  orientation/motion  perception 

estimates  differ  due  to  individual  differences, 
e.g.,  in  somatogravic/inversion  illusions  and 
recovery  time  from  SD  back  to  normal 
(McCarthy  &  Stott,  1994;  Tribukait  &  Eiken, 
2012;  Kraus,  1959) 

a.  Can  the  model  be  tailored  to 
individuals  or  like  subgroups  of 
people? 

1st  ranked 
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Table  2  (Continued). 


b.  Can  the  model  incorporate  the  time 
required  to  transition  mentally  from 
VFR  to  IFR  during  SD,  or  from  a 
fully-automated  vehicle  to  the  sudden 
need  for  manual  operation? 

4.  What  are  the  optimal  self-motion  detection 
thresholds  to  use  in  the  model? 

a.  Laboratory  thresholds  are  defined, 
but  data  is  lacking  in  the  more 
realistic  circumstanced  of  body 
motion  during  vehicle  noise  and 
vibration 

2nd 

5.  What  are  the  data  inputs  and  model 
parameters  for  optimally  estimating  the 
Elevator  Illusion? 

a.  Need  to  replicate  and  extend  Cohen 
(1973)  with  increased  sample  and 
increased  G-force. 

3rd 

6.  What  are  the  optimal  psychophysical 

methods  for  obtaining  data  to  improve  and 
help  to  validate  the  model? 

a.  Good  tests  are  needed  across  different 
perceptual  domains  (Table  3) 

4th 

7.  How  will  orientation/motion  perception 
estimates  differ  quantitatively  due  to 
stressors  such  as  fatigue  or  workload 
(mental/physical)? 

3rd 

8.  What  is  the  best  way  to  model  a  prolonged 
Leans  illusion? 

4th 

9.  What  is  needed  to  further  validate  the 

existing  model  of  the  Coriolis  cross-coupling 
illusion? 

a.  Replication  and  extension  of  Guedry 
and  Benson  (1976)  and  Guedry 
(1977)  is  needed  w/  increased  sample, 
a  greater  variety  of  resultant  angular 
impulse  vectors  and  more  complete 
motion  sickness  data  (Lawson, 

Rupert,  Guedry,  Grissett,  &  Mead 
1997). 

5th 

10.  What  is  needed  to  refine  the  modeling  of 
dynamic  aspects  of  the  G-excess  illusion? 

5th 
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Key  Measures  of  Orientation  Perception 

A  mathematical  model  of  orientation  perception  is  only  as  good  as  the  empirical 
orientation  data  it  models.  Where  perceptual  data  is  missing  in  the  literature  or  is  not  available  in 
the  form  the  model  digests,  extrapolations  become  necessary.  As  the  model  matures  and  is 
disseminated,  supporting  research  should  be  carried  out  to  fill  knowledge  gaps  in  the  model 
(Table  2).  It  is  important  for  this  research  to  employ  suitable  measures  of  orientation  and  self- 
motion  perception.  Table  3  lists  some  current  options  for  gathering  data  on  orientation 
perception,  i.e.,  the  psychophysical  measures  of  orientation  and  self-motion.  The  list  is  not 
comprehensive;  rather,  it  seeks  to  capture  the  mainstream  methods  and  a  few  alternate  methods 
worth  considering.  Pros  and  cons  of  different  methods  are  considered  and  consensus 
recommendations  concerning  the  optimal  application  of  each  measure  are  provided.  The  methods 
are  divided  into  several  categories  for  convenience  of  discussion  (e.g.,  verbal  estimates,  past¬ 
pointing,  cross-modal  matching,  visual),  but  the  reader  should  note  that  these  categories  overlap 
conceptually  (e.g.,  past-pointing  can  be  done  manually  or  via  direction  of  gaze). 


Table  3.  Measures  of  orientation  perception. 


Measure 

Strengths 

Limitations 

Recommendations 

Verbal 

estimation 

•  The  subject 
provides  an 
estimate  of 
his/her 
perceived 
displacement 
(e.g.,  angle  or 
meters)  or  self¬ 
velocity.  Two 
main  methods 

are 

retrospective 
(after  stimulus) 
or  concurrent 
(during 
stimulus) 
reporting. 

•  Commonly 
employed  in 
literature 

•  Easy  to  set  up 

•  Fairly  easy  to 
analyze 

•  Intuitive  and 
rapid  for  subject 
to  learn  and 
apply 

•  Leaves  subject’s 
eyes  and  hands 
free 

•  Yields  useful 
data  for 
modeling 

•  Can  be  challenging  to  do 
concurrently  with  the 
stimulus  (moment-by- 
moment),  especially  when 
more  than  one  aspect  of 
perceived  orientation  is  being 
measured  or  if  other  verbal 
communication  is  required 

•  Likely  to  exhibit  high  inter¬ 
subject  variability 

•  An  important 
measure  that 
should  be 
preserved 

Past-pointing 

•  During  or 
immediately 
after  the 
stimulus,  the 
subject  points 
(with  hand  or 
eyes)  back  to 
his/her  original 

•  Task  is 
inherently 
spatial  in  a  way 
that  is 

isomorphic  with 
the  stimulus 
(thus  enhancing 
face  validity) 

•  Limited  application  beyond 
the  estimation  of  small 
angular  displacements 

•  Requires  some  additional 
equipment  and  analysis 
(especially  for  past-pointing 
with  eyes) 

•  Useful  clinical  and 
laboratory 
measure,  but  not  a 
primary  source  of 
data  for  an 
orientation  model 
seeking  to  directly 
simulate  holistic 
perception  of 
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Table  3  (Continued). 


heading 
direction  prior 
to  the  start  of 
the  stimulus 

body/vehicle 
orientation  in 
operational 
environments 

Cross-modal 

matching 

•  Usually,  a 
manual 

estimate  where 
the  subject 
matches  a 
manual  object 
(e.g.,  a 
joystick)  to 
his/her 

perceived  self- 
motion  and 
orientation 

•  Commonly- 
employed  and 
accepted 

•  Yields  useful 
data  for 
modeling. 

•  If  desired,  the 
subject  can  be 
trained  versus  an 
absolute 
standard  prior  to 
the  experiment 
(e.g.,  learning 
where  10,  20, 

30,  etc.  degrees 
are  located) 

•  Requires  some  additional 
equipment  and  analysis 

•  Requires  the  use  of  the  hand 

•  May  involve  use  of  a  device 
typically  for  control  inputs 
rather  than  matching  of 
perceptions  (careful 
instructions  necessary  for 
pilots,  who  must  ignore  their 
past  associations  with  a 
joystick) 

•  Subject  and  experimenter 
must  understand  that  cross- 
modal  and  verbal  estimates 
do  not  have  to  match  each 
other 

•  Difficult  to  use  this  method  to 
measure  illusion  of  continued 
velocity  without  further 
displacement  (e.g.,  during 
Coriolis  cross-coupling) 

•  A  frame-of-reference 
conundrum  can  emerge:  if 
one  feels  that  oneself,  one’s 
seat,  and  one’s  joystick 
apparatus  are  all  tilted  in 
unison,  should  one  tilt  the 
joystick  or  leave  it  alone? 

•  Estimates  are  limited  by 
motions  possible  with  the 
hand 

•  Many  different  types  of 
cross-modal  matching 
devices  are  used.  Each  has 
different  pros  and  cons  and 
comparison  of  findings  from 
one  to  one  another  is  not 
straightforward 

•  Some  devices  may  increase 
the  likelihood  of  a  kinesthetic 
memory  confound  concerning 
one’s  previous  settings  (E.g., 

•  An  important 
measure  that 
should  be 
preserved 

•  Recommend 
expanded  use  of 
intuitive  devices 
that 

simultaneously 
capture  multiple 
degrees  of 
freedom  of  felt 
self-motion  (e.g.,  6 
DoF  flying 
joystick;  3  DoF 
TPAS). 
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Table  3  (Continued). 


a  haptic  t-bar) 

•  Devices  that  requires  large, 
unconstrained  arm 
movements  during  angular  or 
linear  acceleration  will  yield 
estimates  affected  by  the 
acceleration 

Subjective 

Visual  Vertical 
(SVV) 

•  The  subject 
manually 
adjusts  a  line 
of  light  in 
darkness  (only 
the  light  is 
visible)  until  it 
appears  to  be 
vertically 
aligned  with 
the  gravity 
vector 

•  Commonly 
employed  and 
accepted 

•  Used  clinically 

•  Can  be  set  up  to 
avoid  kinesthetic 
memory  of  prior 
settings  (if  a 
manual  interface 
is  used  that  does 
not  provide 
haptic  position 
cues) 

•  Requires  some  additional 
equipment  and  analysis 

•  This  is  an  indirect  method:  it 
reflects  how  one  perceived 
the  orientation  of  an  external 
object  rather  than  directly 
measuring  self-orientation 

•  Requires  light  in  the 
acceleration  testing  chamber, 
which  could  affect  nystagmus 
reflexes  and  certain  aspects  of 
orientation  perception 

•  This  is  a  visual  task  so  other 
visual  tasks  cannot  be  done 
while  this  measure  is  being 
taken 

•  Method  varies  widely, 
rendering  comparison  across 
studies  difficult 

•  This  is  a  useful 
measure  in  cases 
where  the 
potential 
drawbacks  listed 
at  left  do  not  apply 
to  the  study 
contemplated.  It 
should  be 
considered  for 
inclusion  in  any 
study  with  clinical 
implications 

•  Further 
standardization  is 
needed  regarding 
whether  the 
subject  sets  the 
line  vertically  or 
horizontally, 
whether  the  setting 
is  done  via  button 
press  (to  activate  a 
motor  that  adjusts 
the  light)  or  other 
manual  means  (a  t- 
bar,  a  joystick,  a 
steering  wheel) 

Nulling 

Measures 

•  The  subject 
manually 
provides  inputs 
(e.g.,  via  a 
joystick)  to 
null  the 
perceived  self¬ 
tilt  or  motion 

•  A  direct 
behavioral 
measure  relevant 
to  vehicle 
control  inputs. 
Should  be  very 
useful  to  track 
initial  control 
input  in 
response  to  a 
disorienting 

•  Requires  significant 
additional  equipment  and 
analysis 

•  Careful  design  and  planning 
of  measures  is  necessary, 
because  if  nulling  inputs 
affect  the  actual  orientation  or 
motion  of  the  subject,  then 
the  stimulus  will  be  altered 

•  It  is  more  feasible  to  set  up  an 
apparatus  where  the  subject 

•  A  useful  measure 
but  one  that  is  not 
often  feasible 

•  Most  useful  in 
applied  part-task 
flight  simulator 
studies  looking  at 
initial  control 
inputs  made  in 
response  to  a 
disorienting 
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Table  3  (Continued). 


stimulus 

•  Intuitive  for 
pilots 

attempts  to  null  a  single  axis 
of  perceived  self-tilt  or 
rotation  than  it  is  to  set  up  an 
apparatus  where  the  subject 
attempts  to  null  multi-axis 
tilt/rotation  or  perceived 
linear  translation  or  off-radius 
angular  acceleration 
•  Careful  consideration  and 
engineering  limits  are 
necessary  before  a  subject  is 
put  in  control  of  a  large 
acceleration  device. 

acceleration 

stimulus 

•  Joystick  control 
inputs  in  actual 
flight  are  a  very 
important  source 
information  for 
flight  studies  and 
mishap 

evaluations,  and 
definitely  should 
be  included  in  the 
model 

Non-Behavioral 

Measures 

•  It  is  possible 
that  some  non- 
perceptual, 
non-behavioral 
measures  of 
orientation 
may  offer 
additional 
insight 

•  E.g.,  brain 
activity 

estimates,  post- 
cranial 
physiological 
measures 

•  Some  non- 
behavioral 
measures  do  not 
require 
conscious 
involvement  or 
tasking  and  can 
be  assessed 
while  the  subject 
does  other 
things 

•  Significant  additional 
equipment  and  analysis  is 
necessary 

•  Such  measures  are  presently 
indirect  reflections  of 
orientation,  rather  than  direct 
measures  or  perceived  self¬ 
tilt  and  motion 

•  Disorientation  in  flight  is 
usually  not  recognized  (type  I 
SD),  therefore,  any  measure 
which  seeks  to  reflect  a 
conscious  process  may  be 
limited 

•  Many  physiological  measures 
are  sensitive  but  not  specific 

•  Such  measures 
are  useful  for 
establishing 
cross-validity  but 
are  not  yet 
primary 
measures  of 
human 
orientation 
perception 

Key  Literature  to  Inform  the  Model 

We  identified  the  key  literature  findings  on  human  spatial  orientation  perception  for 
which  a  mature  orientation  model  should  be  able  to  account,  and  categorized  the  key  literature 
obtained  as  of  historical  interest  (e.g.,  seminal  works  in  modeling  of  orientation),  contemporary 
interest  (recent  important  modeling  efforts),  or  interest  due  to  the  fact  that  they  supply  needed 
empirical  data  for  the  model  (e.g.,  non-modeling  papers  with  useful  human  orientation 
perceptual  data  in  them).  The  list  of  papers  is  too  lengthy  for  a  table,  but  is  shown  in  Appendix 
C. 
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Conclusions  and  Recommendations 


•  The  model  accounts  for  the  orientation  perceptions  and  disorienting  illusions  that  occur 
during  many  different  combinations  of  vestibular  and  visual  stimuli.  Further  research 
should  be  conducted  to  foster  the  maturity  and  widespread  dissemination  of  the 
orientation  model  for  applied  use. 

•  We  identified  the  key  research  questions  that  need  to  be  answered  to  foster  model 
maturity.  Chief  among  these  is  the  need  to  determine  how  the  input  from  different 
sensory  modalities  should  be  weighted  to  achieve  an  optimal  estimate  of  the  central 
perception  of  orientation  and  self-motion.  Various  studies  are  planned  or  underway  (by 
the  authors  and  their  colleagues),  which  will  yield  data  to  empirically  refine  model 
weightings  and  thereby  increase  prediction  accuracy. 

•  We  identified  the  key  research  questions  that  need  to  be  answered  in  order  to  extend  the 
model  with  new  capabilities  or  to  apply  it  to  new  applications.  Chief  among  these  is  the 
need  to  model  how  orientation/motion  perception  estimates  will  differ  due  to  individual 
differences,  such  as  are  caused  by  differing  levels  of  flying  experience.  In  the  near-term, 
researchers  should  be  sure  to  track  flight  hours  as  a  covariate  in  their  orientation  studies. 
In  the  mid-term,  specific  studies  on  this  topic  are  needed. 

•  We  identified  the  key  literature  findings  on  human  spatial  orientation  perception  for 
which  a  fully  mature  orientation  model  should  eventually  be  able  to  account,  and 
categorized  the  key  literature  as  of  historical  interest,  specific  contemporary  modeling 
interest,  general  interest,  or  interest  because  it  supplies  needed  empirical  data  for  the 
model.  We  recommend  that  orientation  researchers  use  this  body  of  research  (Appendix 
C)  as  a  guide  when  planning  their  research  or  considering  existing  data  to  exploit  to  make 
model  refinements. 

•  We  considered  the  available  options  for  measurement  of  orientation  perception,  i.e.,  the 
pros  and  cons  of  different  psychophysical  measures  that  could  be  used  to  inform  and 
validate  the  model.  It  was  decided  that  more  than  one  measure  was  generally  advisable, 
with  some  important  measures  to  consider  being  verbal  estimation  and  cross-modal 
matching.  Much  research  remains  to  be  done  to  refine  the  psychophysics  of  human 
orientation.  We  recommend  that  orientation  researchers  plan  studies  with  multiple, 
complementary  measures  (not  necessarily  assessed  simultaneously  in  the  same  trial),  be 
cautious  concerning  the  most  problematic  measures  on  our  list,  and  communicate  among 
one  another  to  agree  upon  a  set  of  best  measures  that  can  be  standardized  or  at  least 
compared  across  studies.  When  the  measurement  of  orientation  perception  is  undertaken 
for  model  refinement,  the  key  measures  should  be  valid  reflections  of  overall  self-motion 
and  orientation  perceptions,  which  could  reasonably  be  expected  to  influence  Level  I  SA 
and  decisions  concerning  vehicle  control  inputs,  rather  than  limited  assessments  of  one 
aspect  of  orientation  function  without  a  clear  relation  to  the  pilot’s  overall  mental  model. 
Of  course,  the  key  measures  should  be  digestible  by  the  model,  i.e.,  quantitative 
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descriptions  of  perceived  linear  or  angular  motion  that  can  be  tested  by  the  model.  A  final 
point  is  that  measures  should  be  relevant  to  the  operational  situation  where  one  is  trying 
to  predict  or  reconstruct  mishaps.  For  example,  Dr.  Rupert  and  colleagues  have  an  effort 
underway  to  develop  a  cross-modal  psychophysical  estimate  of  motion  and  orientation 
that  is  suitable  for  in-flight  research  and  demonstration. 

•  To  date,  the  mathematical  model  of  orientation  has  been  used  to  simulate  perceptual 
findings  from  laboratory  motion  experiments  or  to  assist  with  post-hoc  aeromedical 
evaluation  of  potential  perceptual  factors  contributing  to  known  aviation  mishaps 
(Rupert,  Woo,  Brill,  &  Lawson,  2016;  Rupert  &  Lawson,  2015;  Newman  et  al.,  2012; 
Newman  et  al.,  2016).  A  potential  long-term  goal  for  model  development  would  be  to 
produce  an  in-cockpit  early  warning  system  that  could  predict  disorientation  prior  to  loss 
of  situation  awareness  and  thereby  prevent  SD  mishaps  (Lawson  et  al.,  2015;  Thompson 
et  al.,  2016). 
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Appendix  A.  Spatial  Orientation  Modeling  Expert  Workgroup  (SOMEW)  Meeting  Agenda 


16-17  June,  2015 

Hosts:  Angus  Rupert  and  Ben  Lawson. 

Site:  U.S.  Army  Aeromedical  Research  Laboratory,  Fort  Rucker,  AL. 
Sponsor:  Small  Business  Innovative  Research  program. 


Purpose. 

To  generate  specific  consensus  recommendations  concerning  gaps  in  the  current  mathematical 
model  of  orientation,  needed  research  to  refine  the  model,  perceptual  measures  for  validating  the 
model,  and  gaps  in  current  countermeasures  for  spatial  disorientation. 


Agenda. 


Tuesday  08:00  16  June 

08:00  Auditory  Protection  and  Performance  conference  room  sign-in,  coffee 
08:10  Introductions,  scope  of  SBIR  and  DHP  JPC  AMP  Modeling  projects 
08:30  Current  state  of  the  art  - 

Mishap  analysis  examples 

Inadequacies  of  current  models  and  future  research  needed 
10:00  Break 

10:10  Limitations  to  current  SD  countermeasures  and  recommendations  concerning 
model  extensions  (E.g.,  3D  Audio,  tactile) 
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12:00  Onsite  lunch  (estimated  cost  $  10.99/person) 

13:00  -  1400  demonstrations 

14:00  Recommendation  of  measures  of  perceived  orientation  for  model  validation 
16:45  Adjourn  for  the  day 

18:00  Interested  participants  meet  for  dinner 
Wednesday  08:30  17  June 

08:00  Consideration  of  interactions  and  synergies  of  illusions 
09:00  Recommendation  of  graphical  user  interfaces  for  modeling 
10:00  Recommendation  for  model  expansion  beyond  mishap  simulation 
Ground-based  model  (e.g.,  for  simulation) 

In-flight  warning5 

11:00  Drafting  of  summary  consensus  recommendations  and  action  items 

12:00  Meeting  adjourned.  Interested  participants  lunch  together  before  traveling  home 


5  This  topic  is  discussed  in  Thompson  et  al.,  USAARL  Report  No  2016-07. 
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Appendix  B.  Summary  of  Expert  Discussion  Points  Concerning  Model  Capabilities  and 

Needs 


This  Appendix  briefly  summarizes  nearly  30  points  discussed  by  the  experts  during  their  efforts 
to  summarize  the  perceptual  phenomena  already  accounted  for  by  the  mathematical  model  of 
orientation,  the  phenomena  yet  to  be  incorporated,  and  whether  the  solution  to  filling  model  gaps 
requires  more  empirical  data,  more  refinement  of  the  model,  or  both.  The  papers  of  the  authors 
mentioned  below  can  be  found  in  the  Reference  section  of  this  report  or  in  Appendix  C. 


Capal 

Pheno 

Model 

tilities: 

imena  Currently 
led 

Needs: 

Phenomena  to  be  Incorporated 

Solutions: 
Requirements  to 
Fill  Needs 

1. 

Perception  of  real  whole- 
body  rotation  (per  and 
afteroration)  in  darkness 
and  as  modified  by  cues 
from  visual  surround 

Perception  of  real  whole-body  rotation 
(per  and  afteroration)  in  darkness  as 
modified  by  auditory  or  somatosensory 
cues  (Bles,  Van  Der  Heijde,  Kotaka,  & 
Reulen,  1985) 

•  Helpful  Earth-referenced  auditory 
or  somatosensory  cues 

•  Disruptive  effects  of  loud  noise 
and  vehicle  vibration  (to  identify 
self-motion  detection  thresholds 
in  applied  settings) 

More  data  to 
inform  the  model 

2. 

Perception  of  apparent 
whole -body  rotation 
(circular-vection  and 
optokinetic  after¬ 
rotation) 

More  refined  estimates  of  time-to-onset 
of  circular-vection  and  influence  of  focal 
and  peripheral  cues  on  vection  intensity. 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

3. 

Perception  of  apparent 
whole -body  translation 
(linear-vection) 

More  refined  estimates  of  time-to-onset 
of  linear-vection  and  influence  of  focal 
and  peripheral  cues  on  vection  intensity. 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

4. 

Perception  of  self¬ 
orientation/motion 
during  head  movement 
while  rotating  (Coriolis 
cross-coupling) 

Needs: 

•  Refined  laboratory  estimates  of  time 
course  of  the  illusion. 

•  Refined  laboratory  estimates  of  the 
velocity  versus  displacement  aspect 
of  the  illusion. 

o  Some  info  in  Dizio  and  in 

Holly  and  Harmon  (2009)  and 
Holly,  Vrublevskis,  and 
Carlson,  (2008)  papers. 

•  Modification  of  Coriolis  cross- 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

18 


coupling  by  somatosensory  cues. 

5. 

Perception  of  self¬ 
orientation/motion 
during  head  movement 
immediately  after 
rotating  (dumping) 

Modification  of  dumping  by 
somatosensory  cues 

More  data  to 
inform  the  model 

6. 

Perception  of  self¬ 
orientation  during 
increased  G-force 
(somatogravic  illusion) 

Would  be  nice  if  model  also  accounted 
for  different  types  of  inversion  illusions 
also  (a  variant  of  somatogravic), 
including  tilting  versus  telescoping 
through  one’s  body  vs.  sudden  switching 
(Lackner,  1992). 

More  data  to 
inform  the  model 

7. 

Perception  of  self¬ 
orientation  during  head 
movement  under  altered 
G-force  (G-excess 
illusion) 

•  G-excess  under  identical  G-levels 
produced  by  different  radii  of 
centrifugation  or  aircraft  banking 

turns. 

•  E.g.,  replication  of  Gilson  et  al.  study 
on  larger  sample  and  with  more 
stimuli  (1973) 

More  data  to 
inform  the  model 

8. 

Model  is  good  with 
individual  sensory 
modalities 

Model  needs  more  multisensory 
capability 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

9. 

Model  is  good  at 
estimating  eye 
movements 

Eye  movements  don’t  always  match 
perception;  model  needs  to  improve 
concerning  functional  implications  of 
nystagmus  for  estimates  of  dynamic 
visual  acuity  (at  what  points  in  time  can 
you  not  read  instruments  due  to 
nystagmus?) 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

10 

Model  now  estimates 
perception  when  you  do 
or  do  not  have  sight  of 
instruments  or  outside 
world. 

Model  does  not  distinguish  site  of 
instruments  versus  outside  world 
(assumes  same  effect  on  orientation; 
however,  most  instruments  are  not  an 
isomorphic  representation  of  the  natural 
world  and  require  abstract  thought  which 
will  cause  a  delay  in  decision-making). 

Also,  we  currently  don’t  have  direction 
of  gaze  information  being  gathered 
routinely  and  fed  into  the  model. 

Need:  effects  of  gaze  direction  on  model. 

More  data  to 
inform  the  model 

11 

Model  works  under 

Even  if  model  was  receiving  gaze 

More  data  to 
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assumption  of  normal 
cognitive  state 

information,  model  currently  does  not 
account  for  instances  when  one  is 
“looking  but  not  seeing,”  i.e.,  looking  at 
the  world  or  instruments,  but  not 
cognitively  interpreting  them,  due  to 
distraction  (e.g.,  habitually  following 
instrument  scan  pattern  without  attending 
to  each  new  bit  of  information  properly 
due  to  intruding  thoughts),  cognitive 
blindness  (e.g.,  looking  for  a  car  and  not 
seeing  one,  then  pulling  out  in  front  of  a 
motorcyclist),  staring  into  space  (e.g., 
during  fatigue  or  daydreaming),  eyelid 
closure  (not  seeing  during  blinking  or 
eyelid  drooping),  saccadic  suppression 
(not  seeing  during  small  eye 
movements),  non-foveation  (looking 
towards  but  not  directly  at  a  target). 

•  Short-term  Need: 

o  Quantify  (and  incorporate  into 
model)  the  duration  of  gaze  at 
primary  instruments  prior  to 
making  correct  input  (under 
normal  versus  disoriented 
conditions) 

•  Longer-term  Needs: 

o  Estimate  of  effect  of  fatigue 
on  model. 

o  Needs:  Estimate  of  effect  of 
stress/anxiety /workload  on 
model 

inform  the  model 

12 

Model  can  adjust  for 
different  planetary  G- 
levels 

Model  should  be  able  to  adjust  for 
different  periods  of  exposure/adaptation 
to  a  particular  G 

More  data  to 
inform  the  model 

13 

Model  predicts 
perceptual  data  from 
many  published  studies 

•  Comprehensive  list  of  all  important 
studies  is  needed,  to  determine  what 
important  phenomena  from  the 
literature  are  not  yet  incorporated  into 
the  model 

•  Many  publications  don’t  contain 
enough  raw  data  to  inform  the  model, 
so  one  has  to  contact  the  authors 

More  data  to 
inform  the  model 
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14 

Model  estimates  many 
perceptions  when  proper 
acceleration  data  files  are 
prepared  and  uploaded. 

•  Model  input  files  are  often  labor 
intensive  to  create.  A  user-friendly 
interface  is  in  preparation  that 
transforms  motion  device  or  aircraft 
data  (e.g.,  transforming  acceleration 
vectors  for  the  user)  to  model  input. 
This  will  help  investigators  use  the 
model  more  easily  and  rapidly. 

•  Many  legacy  military  aircraft  still 
lack  a  “black  box”  flight  data 
recorder  to  allow  more  accurate 
estimates  of  moment-by-moment 
acceleration.  This  is  needed,  b/c 
currently  this  info  must  be  inferred, 
(e.g.,  from  radar  hits)  whereas  it  is 
known  with  high  fidelity  during 
commercial  flight. 

•  Black  box  data  is  also  often  under 
sampled  and  methods  need  to  be 
developed  to  transform  these  sparse 
data  sets  to  higher  sample  rates  (e.g. 
100Hz). 

•  Black  box  data  is  often  not  recorded 
at  the  center  of  the  pilot’s  head. 
Transformation  from  aircraft  center 
of  gravity  to  pilot  coordinates  needs 
to  be  considered  before  accident 
analysis  or  modeling. 

Better  user 
interfacing  with 
existing  data; 
better  aircraft 
data  to  feed  in  as 
input  files  to  the 
model. 

A  user-friendly 
interface  that 
transforms 
motion  device  or 
aircraft  data  to 
model  input 
would  help 
investigators 
rapidly  generate 
input  files. 

Perhaps 
modeling 
approach  of 

Holly, 

Vrublevskis,  and 
Carlson  could  be 
used  at  the  input 
stage  of  the 
model  to 
transform  the 
physics  of 
vehicle 

accelerations  into 
terms  the  model 
can  digest 
(2008)6. 
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Vestibular  parameters  of 
model  are  getting  fairly 
mature 

•  Visual  and  visual-vestibular 
parameters  need  more  refinement. 

•  Somatosensory  and  auditory 
parameters  are  lacking. 

•  Army  requires  3D  audio  and  tactile 
cueing  solutions  for  in-flight 
displays.  These  refinements  are 
underway. 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

6  Examples  of  Holly's  approach  in  multiple  cases  is  given  by  her  lecture  in  Lawson  et  al.,  2014  (Appendix  C) 
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16 

Model  does  a  good  job 
estimating  average, 
normal  response 

Model  could  expand  to  allow  for  some  of 
the  individual  variability  in  orientation 
perception  that  has  been  confirmed  by 
the  literature,  e.g.  by  having  baseline  or 
in-flight  data  on: 

•  Role  of  flight  experience  in 
perception  of  motion  (McCarthy  & 
Stott,  1994).  Possibly  different 
perceptions  and  different 
susceptibility  to  SD  (but  had  limited 
sample  and  needs  replication  and 
extension). 

•  Clinical  aspects  of  response 
(vestibular  pathology)  as  they  affect 
orientation  perception. 

o  A  growing  military  and  VA 
need  and  an  important  civilian 
need  which  dwarfs  spatial 
disorientation  aircraft 
mishaps. 

•  Individual  variability  in  time  course 
of  perceived  angular  tilt  (Tribukait  & 
Eiken,  2012). 

•  Sex  effects  on  orientation  perception, 
e.g.,  field  dependency,  field  of  view, 
etc.  Limited  research  here. 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

17 

Model  predicts 
orientation  perception 

Model  needs  to  be  refined  to  predict 
likelihood  of  disorientation  and  also  type 
of  disorientation  (type  I,  II,  or  III). 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

18 

Model  predicts 
orientation  perception 
and  some  types  of 
disorientation  and  motion 
sickness  (Oman,  1982). 

Model  is  being  refined  further  to  improve 
the  prediction  of  motion  sickness 

•  Better  quantitative  estimates  of 
real  and  apparent  motion  stimuli 
causing  sickness 

•  Better  understanding  and 
prediction  of  effects  of  stimuli 
that  cause  both  disorientation  and 
sickness 

•  Better  understanding  of 
interactions  between 
disorientation  and  sickness 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 
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Model  predicts  a  range  of 
linear  motion  frequencies 

•  More  data  is  needed  on  very  low- 
frequencies  of  linear  oscillation,  to 
inform  both  orientation  model  and 
the  motion  sickness  model  (for 
human  factors  design  as  in  mil  stds). 

o  E.g.,  well-known  McCauley 
curve  has  incomplete  data  at 
low  frequencies,  where  it  is 
more  conjectural.  Need  to 
expand  the  curve  and  validate 
it  empirically. 

•  Some  of  this  type  of  work  feeds 
directly  back  into  understanding 
otolith  processing  better,  which  is 
less  understood  than  canal  function. 

More  data  to 
inform  the  model 

20 

Model  does  fairly  well 
now  at  predicting 

Coriolis  cross-coupling 
or  somatogravic 

Need  further  development  to  understand 
interaction  between  cross-coupling  and 
somatogravic,  as  well  as  those 
phenomena  versus  G-excess.  What  is  the 
ultimate  perception  when  multiple 
illusions  are  happening? 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

21 

Model  generally  assumes 
passive  passenger  (unless 
comparing  stick  inputs  to 
perceptions) 

Model  needs  to  incorporate  expectation, 

motor  commands,  and  reafference. 

•  E.g.,  to  know  if  the  pilot  is 
disoriented,  it  would  help  if  the 
model  had  some  idea  of  the  pilot’s 
flight  instructions,  intentions,  or  what 
he/she  wanted  to  do  at  that  moment. 

•  E.g.,  different  perceptions  when  self¬ 
turning  is  actively  generated. 

•  E.g.,  experiments  where  subject  is  in 
the  control  loop  of  the  vehicle, 
providing  inputs 

•  Different  motion  sickness  response 
occurs  with  or  without  reafference, 
but  it  is  not  as  clear  how  the 
perception  will  be  altered  in  many 
cases  based  on  the  presence  or 
absence  of  reafference. 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

22 

Presently,  there  are  three 

Meta-gap: 

More  data  to 
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main  types  of  orientation 
modeling:  orientation 
perception;  eye 
movement,  and  motion 
sickness.  With  certain 
exceptions  Oman  (1982) 
and  Bos  and  Bles, 

(2002),  these  are  usually 
separate  lines  of 
modeling  with  limited 
overlap. 

•  Desirable  to  coordinate  across 
modeling  silos  so  that  one  meta¬ 
model  accounts  for  perception, 
reflexive  gaze,  and  motion 
malaptation  responses  to  be  expected 
with  a  given  stimulus. 

•  Moreover,  model  does  not  account 
for  how  motion  sickness  affects  your 
subsequent  behavior  (e.g.,  head  and 
eye  movements)  and  resulting 
perceptions. 

inform  the  model 
and  better 
prediction  of 
existing  data 

23 

Model  predicts  initial 
perception  similar  to 
transient  leans 

•  Model  needs  to  be  better  at 
accounting  for  prolonged  leans. 

•  Research  needed  to  refine  knowledge 
of  exactly  when  leans  is  triggered, 
how  long  it  lasts  with  different 
stimuli,  and  how  much  lean  angle 
should  be  expected  with  different 
stimuli. 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 
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Model  incorporates 
presence/absence  of 
vision 

•  Model  does  not  fully  account  for 
focal  versus  ambient  visual  functions. 

•  Perhaps  a  non-deterministic  model  or 
partial  visual  state  modeling  instead 
of  vision  off/on. 

•  Could  weight  strength  of  visual  cues 
re.  maintaining  orientation  as  a  start. 

o  But  how  to  account  for  fact 
that  partial,  impoverished 
vision  may  help  you  OR  may 
be  unhelpful  AND  prevent 
you  from  relying  solely  upon 
your  instruments. 

More  data  to 
inform  the  model 
and  better 
prediction  of 
existing  data 

25 

Model  predicts  many 
vestibular  and  visual- 
vestibular  sensations. 

Model  lacks  kinesthesia.  Need  data  to 
use  to  weight  a  kinesthetic  aspect  of  the 
model  appropriately.  (Borah?) 

More  data  to 
inform  the  model 
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Model  predicts  average 
perceptions 

Model  does  not  have  a  formal  false 
positive  and  false  negative  capability 
estimate  for  predictions. 

(this  came  up  in  the  context  of  a  model- 
based  cockpit  display,  so  perhaps  not 
critical  at  this  juncture). 

Better  prediction 
of  existing  data 

24 


Appendix  C.  Relevant  Papers 


A  list  of  relevant  orientation  perception  papers  is  provided  in  this  Appendix.  These  are  the  main 
papers  which  inform  (or  could  inform)  the  current  mathematical  model  as  of  the  time  of  the 
meetings  reported  in  this  paper. 

Key  to  the  Papers 

The  list  of  papers  below  falls  into  four  conceptual  categories.  For  the  convenience  of  the  reader, 
these  four  categories  are  distinguished  cosmetically  via  different  font  types: 

1.  Modeling  Papers:  Citations  in  bold  font  specifically  discuss  the  mathematical  modeling 
of  human  spatial  orientation  perception. 

2.  Data  Papers:  Citations  which  are  in  underlined  font  below  are  included  primarily  because 
they  contain  usable  data  of  potential  importance  to  the  model. 

3.  Historically  Important  Papers:  Citations  in  italics  font  are  of  historic  interest  to  the 
development  of  orientation  models. 

4.  General  Interest  Papers:  Citations  in  regular  font  are  of  general  interest,  e.g.,  because  they 
raise  important  conceptual  or  operational  points  of  which  modelers  should  be  aware. 


These  four  categories  are  simplifications,  since  many  papers  could  appear  in  more  than  one 
category,  e.g.,  many  modeling  papers  also  contain  useful  modeling  data,  some  historical  papers 
contain  elements  of  modeling  which  are  still  used  today,  and  some  papers  of  general  interest  are 
also  modeling  papers  in  a  different  domain  of  human  functioning  from  human  holistic  perception 
of  self-orientation  and  motion. 
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